^Searching PAJ 



1/2 ^— V 



PATENT ABSTRACTS OF JAPAN 




(1 1 )Publication number : 2002-00741 8 

(43)Date of publication of application : 11.01.2002 



(5 Dint CI. 



G06F 17/30 
G06F 12/00 
G06T 1/00 



(21 Application number : 2000-182147 



(22)Date of filing : 



16.06.2000 



(71) Applicant : JISEDAI JOHO HOSO SYSTEM 

KENKYUSHO:KK 
RICOH CO LTD 

(72) Inventor : KUNIEDA TAKAYUKI 

WAKITA YOSHIKI 
IWASAKI MASAJIRO 



(54) MULTIMEDIA INFORMATION RETRIEVING DEVICE. MULTIMEDIA INFORMATION RETRIEVING METHOD 
AND COMPUTER READABLE RECORDING MEDIUM IN WHICH PROGRAM TO MAKE COMPUTER EXECUTE ITS 
METHOD IS RECORDED 

(57)Abstract: 

PROBLEM TO BE SOLVED: To easily create indexes of feature 
information about multimedia information and to promptly and 
efficiently retrieve the multimedia information. 

SOLUTION: A retrieving/registering part 103 preliminarily generates 
a link index 104, a position index 105 and a media index 106 based 
on the feature information of the multimedia information and 
retrieves applicable multimedia by tracing the indexes 104 to 106 
when retrieval conditions are specified. 




LEGAL STATUS 

[Date of request for examination] 14.02.2001 
[Date of sending the examiner's decision of rejection] 06.04.2004 
[Kind of final disposal of application other than the 
examiners decision of rejection or application converted 
registration] 

[Date of final disposal for application] 
[Patent number] 
[Date of registration] 

[Number of appeal against examiner's decision of 
rejection] 

[Date of requesting appeal against examiner's decision of 
rejection] 

[Date of extinction of right] 



.Searching PAJ 



2/2 ^-v 



Copyright (C); 1998,2003 Japan Patent Office 



09)B#H#imf (jp> (12) & IS 4# If ^ ^ (a) aimnmm^m^ 

#^2002-7418 
(P2002-7418A) 
(43)&BBB ¥i&14^ 1 /ill B (2002. 1. 11) 



(51)IntCl. 7 
G 0 6 F 17/30 

12/00 

G06T 1/00 



17 0 

4 19 

5 2 0 
5 4 7 
2 0 0 



F I 

G 0 6 F 17/30 
12/00 

G0 6T 1/00 



f-73-r(#*) 

170G 5B050 
419B 5B075 
52 OA 5B082 
5 4 7D 
2 0 OE 
mmcomi OL (£11 M) 



(2i)as## 


#M2000-182147(P2000-182147) 


(71) ffiSIA 


597136766 










(22)fflgiB 


W-m2*Z 6 /J 16 B (2000. 6. 16) 




mmstemKEaim 1TB1-1 






(71) ffiSgA 


000006747 
















Jf05tffc*:ffll2*J§& 1 T@ 3#6*§- 
















jloKi&ABBix^si&iTBage^ #5£ 














(74) «a A 


100089118 



















(54) [»9i0)«ft] 



v;i^*5^rts&*^$im> v;^^T^7fSftim &&xs*:v>mk*n>\s^-*\z 

10 7J^>f<7 



(57) 

«l» • 1 0 3 iWyi/f^f-r TW 

*<0»*««fc£-^>T y Vr^^ 1 0 4, tK 

:ix^yf^n 10 4 — 10 6 SriU!o-ctt31-£ 



( 101 



102 



WMiWMff • 



107 



tt*x>v> 



( 109 




-1- 



r ?t {c^mtf^^atu L/c-r ^ ^ * v >r strsa 

Mo 

^yfV^ issue y > * fltsu W«R r <b fc«re#^ > 
r t -r^ff #* i fcE«*>^*-* 

v^T-t Jx-tixS'JfiJ-WEBft^ ^ypx «rE«"T 5 - 

•T 5 ^ £ S:*M» t -T 511*5 2 * fell 3 ^IStffi^^yU^- 
£ * b KEt* Lfc r £ St«f» t ir Z>m #m 4 {cEffico^ 

A^*7^T«**Wt*ft. 

-*AS?* 7-V T««<^«l5!5«:*5C * 7 -^^X-f TtS 

fitjE^^^^ x *r r ««<7>rtSEa$i»ffl3fet> # t-SSrt^E 
j:t>*y ^^mm^m^^xm^^^^^ rmmzwi 

U mEJRtt^>-^y^^tt*1»flir«-i:^WEy ^ 



(2) 2002-7418 

2 

<< >7*y 9 xteffim y * fc«rE#^*> a 

W>7 2f ^^^O^J1t*^^L.> ItE^aW 
JO S: W« <b -T 5 7 fcE«c^>^/^ p< -r w r 

[fS^io] HuEE1t§P(i> iuE^^^T^VT^ 

[»*m i] «TE»*«6~l 0©^W-oi: 
EttSnfc^fttavtT^-^fcSlfTSiirS^o^^A 

ttEfttt*. 
[0 0 0 1] 

^4 5^/^^7 ? ^rflip«tii*as«, 

S^o^^ASrEfiLfes^ti'a — RTflBfcE 
i»iL, ^/^^ 7-Vrtf Scov^to* 

[0 0 0 2] 

^ lS£*o&fl¥] Hife. ^^ctr>'^^^ h 

[0003] me>^»»fl»*tt, ^©^rVr^w 

50 a-T-5wi:3isJliUv\ Sfc, #»«*«^ v^v'^ 



-2- 



1 f 



3 

l t raw >*fy#* ti^thwzz s *lt v ^ 
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[0 0 0 6] rtb^cor ^^e>, -riV^f-* 1 ?* Ttt$g{C 

[0 0 0 7] zcnmmte, JLjeufc«e*ft*«-J:SBSJH 
S: HHB-J- 5 *6 (c ft $ ttfc o fc «9 . ^ 

[0 0 0 8] 

r HulB^^^^ rfifi&coi&^Sris r ft 5 -v^* 1 ? 

IS *IB»««*5 J: y > * BSffi £ ^ V > T SfJ t 
[0 0 0 9] ^<Dm#.*&l<0%£WiZ£.tllt y -?}V^-^^f 



(3) 2002-7418 

4 

[0 0 10] M*«2CO^0J(C^^>^^^t : V 

^»a'j*«Sr««pb, away vr^^^diiay 
r <t Ottawa * 1 1 r««pi- ^> r. t * ^ i~ 

-So 

[ooii] r<D»**2^)5£W^J:ixtf, Ktt-f^T* 
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a^^^B l 0 tt, «S« ■ f*l^f£yiSP 10 14:, 4$ 
50 *ft«=R36« 102^ «WR • SftS 103^ y >^ 



-4- 



7*3«fcU^i OS m&'(>"ryi?* 1 0 9*3«fctM 1 
0 fc36»bft5 0 

[0033] mmm • F^^tsa!^ lout ^-^^ 
tt= ^^y<o«»{k«!aafewcMP e g 7 ks<5< 

[0 0 3 4] □y7>7ID=0 0 00 00 

10«3yry7^«ittlt5^C(i, (a) ft 

ssi»«*f-*<5< # h^ttafc«ts«itft (was* 

fgID=0 0 0 l) , (b) AfflttS<bWtaft 
ttfcti (»JhWte#»ti»« «ttID=0 1) , (c) fi 

0 2) , (d) V^#-T5rtS1Eifi (t 1 ** M» 

« ^£ID=0 3) ir^9«3g^ft!fS«ri3r*5o * 

fSai^^TMPEG7 ^S^^^rtSiEazE**5r* 
5 (rt*1Sjfi ID=0000001) . 

[0035] io2(t T-f&mmc 



(5) 2002-7418 

* [0 0 3 6] ^ - i o 3 wmmtit • f^ie 

0 5joJ:O7fVT^yf>^^i 0 6) 
[0 0 3 7 ] aftwt-n, i*&fl?#f • p^tea^ 1 0 1 

4, /f 3 W 7 ^ ^ l O 5 J:^ rV T-Y > 
7*y?* 1 0 6) Sr£/Si-5 0 

[0 0 3 8] yy^>f-;nio4ii yy^iD 
IDI^C, ^rVriD, H*6«F*J*3j:t/»T«F*JS: 

[0039] fcita; 



4, 5 



JgttID=0 1 ttimSFJr /-KIDl, 3, 

JStt I D = 0 2 (WW ttjgLSEff y — K I D 2 , 5 

niiD-03 (f«h) mmfflBff /— KID1, 2, 

l 0 S^t/^T^T'f ^"fyf* i o ©4*»««i:^~A: try y^lD=0l «:««*-** 

6 fiJ^Tt-^-TJ: 5 Kft5 0 ftfc\ «tt iDOKi [ o o 4 o ] 

< y y^^y^ 1 0 4 > 

!iy^ID = 01 ^y3yiD=l, 3, 5 
y>^ID=02 ^v^v'a > I D = 2, 5 



[0 0 4 1 ] 



y I D = 0 3 


y I D = 


= 1 


, 2, 3, 4, 


5 




















aKv^v-s 1/ I D = 


1 /f^7ID=0 


1 


BM&=00:00 


00 


»T 


=00:00:10 


Tjf^v-a >ID = 


2 ^fW7ID=0 


1 


BM&=00:00 


10 


»T 


=00:00:20 


tf^v-a yiD = 


3 It <1 I D== 0 1 


BS#?=00:00 


20 




=00:00:30 


tf*J*s ayiD = 


4 *f*<(7ID=0 


1 


M*&=00:00 


30 




=00:00:40 


/tf v^>a yiD = 


5 /f'-fTID=0 


1 


M#?=00:00 


40 




=00:00:50 



[0 0 4 2] 



[0 0 4 3] &fz. 



<^TV7-f yf^^^ i o 6 > 

^f>7ID = 01 3y 7 y7I D =0000001 ^^f AT I D =0000001 



»&ft=£LTR;6U (yv^ID) 

^^y??. l 0 5 SrjyoTtUaffiBSrW^-rs 

/tfv^Va yiD=l li a I D= 0 1 



<t£t>K, a w >f y ^ ^ i o 5 ciat 

[0 04 4] fc4:x.tf, Sl^y^y 107H!I^ 
i d = o i i^5»*tt**#fcft5>tf, :«yy^i 

D=0 1 j&>e>atf$^>a W >7* y 9 * 10 5 SrffioT, 



=00:00:00 ^T=00:00:10 



-5- 



(6) 

9 

zKv^v-a yiD=3 It O I D= 0 
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fV7^yf«7^ i o ec^t^f-^Ii^^^t: 

[0051] mz, mi\^\^tz.-?su7-?i7*jTmntk 

3 tt, [Hi (c^ L/c^A-^ r««SI^3Sfi: 10C 40 
[0 0 5 2] [^Uin^-J: 5 C Z.(D^J^^ Tit 

*8»kh i o -ctt, s-r »«j^a»A#K^«B io2' 

S30 1) , tft5RA«=Sr»»L-C Uf^S3 0 
2) N tUSRm^^^SraR-rs Ur^S 3 0 3) 0 
[0 0 5 3] -t LT> mULtz^m^^^^^Mff^X 
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1* gH*6=00: 00:40 =00: 00: 50 
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L Uf^S 3 0 6) , «**-&*rf^«i-5 (^^^ 
/S 3 0 7) 0 

[0 0 5 4] #cte, HI l tc^ LtzVkteimt ■ rt*Ki£*B 
1 0 1 |c«tSrt*IBJ6«>— ' PJ^ol^T»Wi"S 0 04 

[0 0 5 5 ] RHa^-t-J: 9fC r<0!ftffc*P*f • rt^is 
3*35 1 0 1 Xte s m\±#4y p (attribute type) , &m 
sOfypx (feature index) W^S'SWC !J > 
?ftfrbt£%fa^W& : &te^t£^X^% 0 #*5, PIHC 

[0 0 5 6]fc D^^^ 

«r^1-0-e*>5. **5, [rIIH (a) ^fi**-f >"7*s/^ 
*£^U (b) (:iiy^^fV7^^i04^ 

tj^U |p]0 (c) (Ui^v'ay^yf^^^lOS^ 

[0 0 5 7] (a) l^tJ:^:, tfcaf-f ^t*** 
* (feature index) Ji N ^y^af-y/i^B-y!l 
'-•CMtSIt^ttS^, ^ coffin >x 5/** HI 

[0058] r. r r*fi, WffltW* FAi^yyn is*f 
y^^io5^yy^iDooon:^tt, fa 
2^yy^ idooo3 c^^tt, FA3^yy^i 
D0 0 0 6i:^j5^tts FA4iyy^ idooo?!: 

FA5&y>-^ ID0008 iZttJt^tttz^ 

[0 0 5 9] FB'l^yy^IDOOO 2i;^ 

<5tt, FB2&yy^ID0 0 0 3i:»Jj<5H FB3 

^yy^iDooo4 c^^tt, FB4^yy^iD 
0 0 0 6 ^*t«<5rt-^B-y y — fc*L-CV^S 0 

[0060] (b) n^tJ;9f:, y^^-r>x^ 
^^10 411 yy^iDoooi-ooo8:'i:[:^ 

^aWyf^^ 105^1 D**tJC-^»t*:f — ^ 

[0061] yy^iDoooi £-^v-3 

V-T >T*y#X 105(DIDP00 ljoJ:tJ<P0009 
^#JCSM-»t, y^ID0 0 0 2^>3W>7 5/ 

^io50idpooo6 {£2t/£ft-f:)\ yy^iDO 

0 0 3 Sr^^i^g V-f >7* y # X 105COIDP000 
3*3«tt>*P 0 0 1 0i£*r/£tttf\ yy^ID0 004^ 
aK^^g V-O-rV^^ 105COIDP000 4(1^ 

#tt, !) y^ I d o o o 5 Sr^'>3 W yf i 
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a y^yf^^^ i05^iDP0007^oJ:rj<Poo 
i2(:»n yy^iD0 0 0 8W^y 3 y^y 

f^^^l05WIDP00 0 8^j£ttft/c^£^ 

[0 0 6 2] fWjd (c) {Cl^-f £ 3 ^>aWy 
t<>^10 5H ^^> 3 yiDr^:A-t" (mo 
vie) , s<y^r— i? (pak) , ir^^h (seg) teXTf 
*~ (key) ^bttSfflBWWtWJEE^tfc^-^-e 

[0 0 6 3] H5te*L*:*ft*-f y 9 X b V 

l 0 4 coy ^^IBaSrRW-t-Sfcfe^RWBI 

[0 0 6 4] i^ia^^-r j: o **sis*«cs^v>r* 
Cite, :or i tc^-£fc,z> yy^iDOOOi, ooo 

3, 0 0 0 6^oJ:t>*0 0 0 8^, ^ttl^tlV >X 
y 1 0 4^(D—m<D^^ fjnDVffl&Skfc'to * 
R2^tl^yy^ ID0 0 0 2, 0 0 0 3joJ; 

0*0006 cov>rt) yy^-f y?7 ^104 ^co— 
[0 0 6 5 ] z<DXo^ »5R»*^#b*i^ft&tf, 
*iD&t*ffiu yy^>fyr5/^^i04^i^ 

v^>a W ^f* ry^* 1 0 5— coy ^5fc£Stf#1~5w 
b&X*Z?> 0 

[0 0 6 6] jfcK* E]6 ^T^Lfclt^fe^R 1 jocfct^R 
[0 0 6 7] H6^^L/cJ: &5ff*£JHR l*3«tt>* 

R2CH yy^iDooo3^i:r>'ooo6^i(: 
^idooo3^^6^ /f^i/3y^yf>^^io 

5OIDP 0 0 0 3, POOlOW^tbtl, y> 
^^ry^^ I04oyy^ ID0 0 0 6 SrftS^:, 
W yfi/^^ 105C0IDP00 0 2^W/S 

[0 0 6 8] r T\ i5 (c) {d^Lfc^v^v-a W 

P 0 0 0 3Hfl Moviel, Pakl, Seg2, Key1/^*t/£^tt 
<b*lTl^5 0 Sit. POOlOtcte, Movie2, Pak1, Se 
g2, Keyia$#JS^tfib*U P0 0 0 2CI1 Moviel, Pa 
kl, Seg1, Key2riS»lt<5ttb*xT^S 0 ^cofctf), *te 
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[0 0 6 9] ScKl, d 1 ICtf Lfc-^vu?"* T««8t 

8tt, I 1 l^ivy^^ T'Wiif 1 0 C 

[0 0 7 0] WH^-TJ: 5*c gf/sufc^vxv^ (Ne 
w Content) 8 0 1 £3£^rf S^^te, m^yr 
y^80U\ fa&^ti&^y 4 # (Description Edito 
r) 8 0 2JC<toT4*«««^rt*IEjfi*nSi:tt> 
70 31 ^y-^yT-ty^^r^ (Content Analyzer) 8 0 

3(cJ:ot^^yy ^-^f >fy^^ (Taxonomic Inde 
x) 8 o 4ic»«*£*i5. &*5 % 3yfyyg#tt, f 
v?;* h u— i/ 3 yso 5^LT^yryyf^8 o 

[0071] ^lt, ^yfyy^t^i^cii, 

^rrL— y — v^^u— ^ (Query Generator) 8 1 OC 

^^Sri^u :ixia^^y/^wyf^ 

^8.0 4^LT, bT a — v?;n*U— ^ 

(View Generator) 8 1 1 ^tH^i"S 0 *r<£>^ r<£>fcf 

£#>T=i >y> r yy*y^' J f (Content Browser) 8 12 
[0 0 7 2 ] ±»LT#rt:,fc5K:, -*IBfi©»«-ett, 

'^nio sas.tuMT*^ >7*y?x i o 6££/& 

1 0 4 — 1 0 6£^oTf£^i~£^A'^7"H'T 
[0 0 7 3] 

[0 0 7 4] »*3S2©»W^J:ixtf, JRtt><> 
yy^^t, y yNyf^^^^ tKv^^ 3 >"7^ 

■Mtw^y^^, yy^^yf^^^W^a 

[0 0 7 5] W#3l3^J8W^«fc<xtf, 
50 IfStco^T^tLmSiJfflJcJRtt^V'ry^^SrEtt^ 
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r*ft< , tzt Ha** tmmt^^tz^m^o^^x t>is 

[0 0 7 6] Sfc; »*«4©38W^J:ixtf, #i^>s 

[0 0 7 7] W#«5^»Wt-J:*U*, -vju?-*- 

M^7>f7^f^^ MJt3£ SfttURLi if b 

rs-ts^A'^ rsraa^Kflj-r 5 r t a* *regft 

[0 0 7 8] Sfc, »*^6^55W^<tixtf, ^A^y< 

-*iV*f-* 7 s J Tffin<D&m : £&&faO$)^8i < *5 ^ ft ? 

[0 0 7 9] Sfc, M#«7<z>*«fcJ:*i«, Jltt-f> 
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[0 4] 



Feature Descriptions 

attribute type-*A"> 
<FA1 /> 

<Hnk="Movie1 :Pak1 :Seg1 :Key1 V> 

<link="Movie2:Pak1 :Seg1 :Key1'7> 

</attribute> 

attribute type- 'A"> 

<FA2/> 

<link= M Movie1 :Pak1 :Seg2:Key1 "/> 

<link="Movie2:Pak1 :Seg2:Key1'7> 

</attribute> 

^attribute type="A ,, > 

<FA3/> 

<link- 'Moviel :Pak1 :Seg1 :Key2"/> 

</attribute> 

<attribute type- 'A"> 

<FA4/> 

<link= n Movie1 :Pak1 :Seg4:Key1 "/> 

<link= w Movie2:Pak1 :Seg4:Key1 "/> 

</attribute> 

<attribute type="A"> 

<FA5/> 

<link="Movie1 :Pak1 :Seg4:Key2V> 

</attribute> 

ottribute type= M B"> 

<FB1/> 

<link- 'Moviel :Pak1 :Seg3:Key2'7> 

</attrlbute> 

<attribute type= n B"> 

<FB2/> 

<link="Movie1 :Pak1 :Seg2:Key1 V> 

<link="Movle2:Pak1 :Seg2:Key1 "/> 

</attribute> 

ottribute type="B"> 

<FB3/> 

<link="Movie1 :Pak1 :Seg2:Key2"/> 

</attribute> 

<attribute type="B"> 

<FB4/> 

<link- *Movle1 :Pak1 :Seg1 :Key2"/> 
</attribute> 
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■um««*«j*u away ^^v^y **teBuiay > 
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[HI6] 
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